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The National Cents/ for Research in Vocational Education's mission is to increase (he ability of diverse agencies, 
fnstilul^ons, and organisations to solve educational probfesns relating to individuai career pianning. preparation, and 
progression. The National Center fujtiUs its nriission by: 

• Generating knowledge through research 

*' Developing. educational programs and products 

• Evaluating mdividual program needs and outcomes 
Providing inlormalion lo^ national planning and policy 
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FOREWORD 



The yearly dissemination and utilization conference held at the National 
Center for Research in Vocational Education has traditionally offered 
dissemination specialists the opportunity to discuss mutual problens and 
solutions and to learn about the best nsw materials available in vocational 
education. The Third Annual National Vocational Education Dissemiaat ion and 
Utilization Conference, held at the National Center on November 12-14^ 1980, 
focused on the theme, "Organizing for Dissemination Collaboration.^' 
Fifty-five participants from thirty states and the District of Columbia worked 
with more than twenty National Center staff members on dissemination problem.*^:, 
promising practices, and collaboration plans. Participants were parsonnel 
responsible for dissemination activities in state Research Coordinating Units 
(RCUs), Curriculum Coordination Centers (CCCs) , state departments ^f 
education, and universities. Principal speakers were Dr. Charles Mojkowski, 
of the Education Service Group, and Dr. Daniel Dunham, visiting sc lolar at the 
National Center. 

These proceedings represent every segment of the conference agenda, including 
the major presentations, descriptions of exemplary programs, and t^e outcomes 
of the work sessions on problems, practices, and collaboration plaas. Recog- 
nition is due the reviewers: Dr. Dee Wilder, Nashville, Tennessee, President, 
National RCU Association; Dr, Francis Tut tie. State Director for V:)cational 
Education, Oklahoma; and Dr. Robert D. Bhaerman , National Center f yr Research 
in Vocational Education. Project director was Dr. Norman M. Singer. Dr. 
Carol P. Kowle was the conference coordinator. 

Robert E. Taylor 
Executive Director 
The National Center for Resear::h 
in Vocational Education 



vii 



EXECUTIVE SUMMARY 



The Third Annual National Vocational Education Dissemination and Utilization 
conference/ held at the National Center for Research in Vocational Education 
on November 12-14/ 1980, focused on "Organizing for Dissemination Collab- 
oration," The conference was structured around three major work sessions. 
Outcomes included agreement reached on the major problems facing dissemination 
personnel in vocational education; a list of practices and successful 
strategies for dissemination; and collaboration plans linking information 
needs with resources which were, in many cases, available at the conference. 
The principal speaker, Charles Mojkowski^ Vice President for Program Develop- 
ment, Education Service Group, emphasized principles for dissemination 
collaboration , including: 

<*Stressing both differences and similarities among collaborators 
<>Paying attention to the cost of not collaborating 

Establishing inter- as well as intra-system relationships 
oEstablishing a strong conceptual framework, then working on technique 
® Increasing incentives for collaboration 

Mojkowski also emphasized the promise of electronic communication for improved 
di ssemination • 

The major problem identified by the participants was the need for administra- 
tive commitment to dissemination activities. Suggested dissemination strate- 
gies were covered under such categories as establishment of communication 
networks, development of exemplary programs and models, encouragement of 
professional development activities, and working with collaborators at the 
local level. Exemplary programs presented included those of the states of 
Oregon, Pennsylvania, Florida, and Oklahoma* Thirty states and the District 
of Columbia were represented. 
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"Organizing for Dissen-ination Collaboration" 
Charles Mojkowski 
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Education Service Group, Inc. 
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ORGANIZING FOR DISSEMINATION COLLABORATION 
Charles Mojkowski 



The theme of this Third Annual Dissemination and Utilization Conference is 
addressed to a most timely topic. Over the last few years, dissemination 
resources and services in vocational education have developed at a rate at 
least twice that of any other area. The Dissemination and Utilization Program 
here at the National Center is a major excimple of the commitment being made to 
provide practitio iers with exemplary programs, practices, and materials to 
address identifier needs. As in all of our endeavors, these accomplishments 
have in turn created new needs, foremost among them one for increased 
coordination. I believe we are entering a period in the development of 
dissemination resources and services when greater efficiency and increased 
accountability will be necessary. Tliese requirements for increased 
coordination and collaboration are the subject of my presentation. 

Over the last ten years, I have worked in dissemination at every 
level — national, state, local. In all of my work, I have tried to servf^ as a 
middleman between those theorizing and studying about dissemination and those 
actually doing it. I have worked as a linker among growing networks of 
disseminators. More recently, my work in dissemination has been focuseti on 
the use of technology to support networking and collaboration among 
organizations supporting school and district improvement efforts. 

Today, I would like to share with you some insights I have gained from 
these experiences and to suggest how you might improve your efforts in 
organizing for dissemination collaboration. 



I would like to focus my remarks on four questions: 

1. What are we trying to achieve in our conduct of 
dissemination activities? 

2. How will collaboration contribute to this achievement? 

3. What impediments exist to greater collaboration in 
dissemination? 

4. What operational principles can we use as guides to the 
development of collaborative dissemination activities? 

Note that I have not said "vocational education dissemination." That is not 
because I do not recognize the need to xanderstand the particular 
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dissemination requirements of the vocational education commanity; thcjt is a 
very important consideration. I believe it is more important first to 
imderstand and address these questions from a broader point of view and, in 
doing so, to open rather than close our perspective on the larger context in 
which vocational education dissemination exists* 



Definitions 

Before turning to uoese questions, I should explain how I am using the 
terms in the title of my presentation. By organizing I mean, "to give 
purpose, structure^ and order to an activity-" Organizing implies 
deliberation and design, not serendipity and happenstance. My operational 
definition of dissemination is that employed by the Dissemination Analysis 
Group: four categories of act ivities-^spread , exchange, choice, and 
implementation. As a member of the Dissemination Analysis Group, I 
contributed to the development of that definition. Lately, however, I have 
begun to feel that its all-encompassing scope has less precision than is 
needed • Nevertheless, it is useful in appreciating how diverse dissemination 
and utilisation activitiet^ need to be* Finally, I use the word collaborate as 
Webster defines it: "to cooperate, to form a partnership or alliance for the 
conduct of activities." Traditional uses of the term related to the arts and 
that is fitting, since there is quite an art to collaborating, as I will 
discuss later. I am not using collaborate to mean to cooperate with the 
enemy, as in John LeCarre's Tinker, Tailor, Soldier, Spy although there are 
times when this may, unfortunately, apply. 



School Improvement Goa Is 

With those understandings in place, let me move to the first of my 
questions: What are we trying to achieve in our conduct of dissemination 
activities? My approach to this question is one commonly used in planning 
make the problem bigger in order to understand better its context. In doing 
this, I recognize that the principal goc.1 is to support what Guba and Clark 
identified as "improvement oriented change in education" or what we have 
fashionably renamed school improvement* Within this broad goal, four major 
objectives appear central to our work with practitioners at all levels. Our 
support should help practitioners: (1) to be more analytical in identifying 
deficiencies, (2) to employ more comprehensive and high quality planning and 
development activities, (3) to use a greater quantity and quality of 
information resources in assessing and addressing problems, and (4) to 
strengthen our clients' residual capacities to handle successfully the next 
problem that comes along. 

Of course, there are many secondary objectives. A few are: (1) 
increasing the relevancy of our R&D efforts, (2) getting validated R&D 
outcomes used in school and other learning settings, and (3) increasing 
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"vertical" and "horizontal " communication among educators at all lev<?ls and ir 
all fields. Despite their importance/ however/ we must recognize these 
objectives for what they are-— as means to an end. 

Although it is too early to determine the impact of this flurry of school 
improvement activity/ it appears that the emphasis on needs assessment and 
planning is resulting in a more focused demand for information/ resources, and 
technical assistance. Not only has the volume and quality of assistance 
increased/ there Js a growing emphasis on assessing the impact of dissemina- 
tion resources and services in terms of how much they contribute to impi^oved 
school and student performance* 



Contributions of Collaboration 

It is hard to quarrel with such notions. Then what can collaboration 
contribute to the realization of those school improvement goals? I believe 
there are several contributions: (1) a reduction in unnecessary duplication 
of efi^ort/ (2) an increased focus of a critical mass of resources for 
supporting school improvement activities / (3) easier access by practitioners 
to information, resources, and technical assistance^ (4) an increased impact 
on important indicators of system performance, and (5) an increased ease in 
assessing such impact . 

If / indeed, there are so many significant contr ibvit ions which a 
collaborative approach can make/ why then are our efforts so characterized by 
fragmentation and unnecessary duplication, and by minimal impact at great 
expenditure? The answers lie in part in our approach to dissemination and 
utilization and, in part, to the requirements of collaboration. Together the: 
form a set of substantial impediments to collaborative dissemination. 

First, let me describe briefly some common inadequacies in our 
dissemination and utilization activities* 



Inadequacies in Dissemination and Utilization Activities 

Inadequate Attention to the Client Perspective 

Our clients are grossly underrepresented in the design and development of 
dissemination resources and services. How many of us, for example, have 
actually observed a user working with the materials we disseminate, whether i" 
be a brochure, a program description, or an information search of ERIC? How 
many of us have had potential clients help us design a brochure/ conference^ 
or workshop? 
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Inadequate Focus on Specific School and Student Performance Deficiencies 



Failure to target dissemination resources and services to specific 
performance or program deficits results in costly shotgun approaches which are 
difficult to evaluate. 



There is a tendency to focus on products and dissemination delivery 
mechanisms rather than on developing a strong conceptual framework v/hich 
addresses basic questions about clients/ their needs, the context in which 
these client needs exist, and about basic principles of improvement oriented 
change- No amount of technical accomplishment will compensate for inadeqxiate 
design . 

Creating Client Dependencies 

Often the dissemination and technical as;\:istance resources v^*a provide 
perpetuate and increase client needs by creating or increasing their 
dependency on still more assistance. Neglecting to foster improved client 
capacities to handle subsequent problems more independently eventually results 
in atrophy rather than a growing capability. 

Failure to Maintain Continuity 

Too often our dissemination services are one-shot affairs with little 
attention to follow-up and support to promote use of what we are 
disseminating. The effort to increase the quantity of users served usually 
results in superficial impact. Recent research speaks to the criticality of 
the utilization or implementation stage in change processes. 

Each of these problems is the focus of years of experience and hundreds of 
pages of research and documentation. Despite my cursory review, it is not 
hard to illustrate these failings as they are reflected in our development of 
information resources, delivery mechanisms ^ and dissemination management 
procedures. Whether it be the information center that fails to prepare 
information in a form that its clients can use, the linker who mails out 
information to clients with little or no follow-up, or the lack of compre- 
hensive needs sensing and evaluation mechanisms, our present dissemination 
activities need to be strengthened through greater attention to 
conceptualization and design, development of a client focus, and an emphasis 
on improving practitioner capacity to seek anci use information in addressing 
iden^:if ied problems . 



Emphasis on the Technical at the Expense of Design 
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Inipedim ents to Co l labor atio n 



In turning to a discussion of some common impedime^nts to greater 
collaboration among dissemincitors , let mf^ first make a few background 
comment?:. In many ways ♦ the failure of disseminators to collaborate 
effectively is a reflection of a pervasive societal problem. We have become a 
nation of special interest groups, e^ch with sufficient power and resources to 
secure benefits for itself while lessening the total benefits to society • 
These special interest group<^ are able to block efforts which impiinge on the 
needs and wants of their members v;hile at the samf=^ time admonishing other 
groups to do what is in the comnv^n interest* Perhaps tnis phenomenon is just 
.=inothe>: x>rodiict of the 1970s as thb "me decade," but I believe its reasons are 
more fundamental than we would like to admit. 

It has become fashionable to blame the fediziral establishment for the 
fragmentation and duplication that exist^'3 andy to ?;ome extent., this may be tho 
case. Certainly the federal dollars whiich support this dupliOf?tion help r.o 
perpetuate the problem* Meaningful federal incentives to collaborate and 
coordinate generally are lacking. To a tn:v:h greater degree, however, the 
fault is with us in tb^t we see our-^elves much as special int^^rest groups. 
\^l]ole new programs are established where refinement c? existing activities 
would be sufficient. Once estabJished, we are forced to justify ourvSelves, 
and that requires that we emphasize our uniqueness- We figh:. fragmentation 
and unnecessary dupliceit ion until we ourselves can benefit from it. 

Ijet:*s argue, hov;ever, that most of us re!..ognize this pt-rvasive problem and 
are eager to address it. What impediments can we expect to encounter? I^t me 
outline a few major ones* 

Impra ctica l or Va gue Goals for the C o 1 lab or a t i ve Effort 

Broad and generol statements of common purpose usually are developed to 
guide collaboration among orc3anizat ions . Tliis vagueness allows ^iach member of 
the collaborative efforV. to negotiate specific roles v/ithin a broad area, but 
the lack of specific objectives makes it difficult to accomplish substantive 
object iv€<s . 

failure to Accurately Esti mate the Costs o f Col labo r ation 

While collaboration ultimately results in greater impact and efficiency, 
there are several categories of costs that need to be considered. Fir£=:t^ 
there are the very real costs in time, human resources, and dollars that are 
required to maintain existing operation?^ while planning and implementing 
collaborative ventures. As discussed previously, however^ the major "costs" 
of collaboration are realized in the diminishing of separate and individual 
efforts. One of the greatest impediments to collaboration tlie quality of 
many of the individual efforts. The very success which we .strive for, once 
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realized, makes it difficult to want to collaborate with others, particularly 
when compromises are required. Of ten / it is these less tangible costs that we 
feel we cannot afford to pay. 



Insuffici e nt and Inadequate Incentives 

As I mentioned previously/ there are few incentives to collaborate. 
Indeed, the disincentives are considerable. Policymakers at federal, 
national, and state levels have failed to construct the necessary carrots and 
sticks to move ixiople with special interests to reach out and compromise* 

Inadequate T ec hnology fo r Exchange and S haring 

In my w::rk with dissemination organizations over tl:e last ten years, I 
have obsGT^j.id the difficulties encountered in attempting to maintain frequent 
communications and common work agendas. Meetings and workshops are costly ard 
lack sufficient continuity. Telephone and mail communications are seen as ac 
hoc and superficial. Networks of collaborators have failed thus far to make 
use of emerging technology in communications and resource development. 

These are just a few of the impediments we must address in seeking greater 
collaboration. We fail in our efforts to collaborate not so much from a lack 
of understanding of these problt^ms, as from a lack of courage to risk the 
coordination which, while increasing the impact and cost-effectiveness of our 
total efforts, diminishes a small number of individual programs. If 
unnecessary duplication exists, then weeding it out through increased 
collaborative efforts means losses for some programs, but with a greater 
critical mas^ of resources focused on major needs. 



Given this asstr'ssment of impediments, what x^rinciples can we follow in 
developing <jr strengthening collaborative dissemination and utilisation 
activities in voc-fi tionai education? What deliberate actions can we take to 
promote the par t:nershi})s that are necessary to realize tlie goal and objective s 
of vocational education legislation? 1 believe there are several guideposts 
we can follow in o^xr future efforts. 

Differences and Similarities 



Ask not only how you rjre different or unique in your conduct of 
dissemination an.l utilization activities; also ask how you are similar to 
others. Stressing our unique contributions to overall goals and objectiveis is 



P rinc ij^l e s^ for Col laborative Oissemin at ion 
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necessary and important. More important, however, is an analysis of common 
strategies, tactics, or clients ♦ These are our most immediate sources of 
collaborative activities • 



Pay Attention to the Costs of Not Collaborating 

In a system that finds it politically expedient and simple to create new 
programs and politically difficult to phase out those no longer neadefl, it ie 
important to emphasize the costs of failing to collaborate — unnecessary 
duplication, fragmentation, a lack of coherence of resources and services, and 
a resulting lack of traceable impact on nationwide and local needs. 

Est ablish Inter- as Well as Intra-System Relationships 

As important as strengthened working alliances are among members of the 
vocational education network, equal attention needs to be given to ].inkip*g to 
other dissemination systems which are trying to support school xmprovem<int 
activities. The ^Jational Diffusion Network, State Capacity Building Pro;ects, 
Elementary and Secondary Education Act Title IV, Special Education, ard 
numerous other program efforts have something to teach and something to learn 
from the vocational education dissemination and utilization network. 



The Whole Is Greater Than the Sum of Its Parts 

Despite the costs of collaboration, the benefits are substantially 
greater. Most important is the increased coherence of our resources and 
services* The primary beneficiaries of this coherence are our clients who now 
look out from their schools at a relatively disorganized and diffused array of 
products and services delivered through a myriad of linkers and change agents 
oblivious to or disregarding each other's efforts. Also important is the 
increased ability to trace the outcomes and impact of a more efficient set of 
resources and delivery systems. 

Establish a Strong Conceptual Framework, Then Work on Tactics and Techniques 

Dissemination strategies are more than a collection of technical 
capabilities in search of innovative uses. They need to be based on judgments 
about the nature of the clients to be served, the resources needed and 
available for providing services, and the way in which knowledge resources can 
best be provided to clients- Questions which reflect some of the concepts 
which need to be addressed more carefully are as follows: 

1. How does dissemination relate to other program improvement 



services available to clients? 
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2. How does information utilization improve educational practice 

3. How do clients seek and use information to bring about 
practice improvement? 

4. What incentives can be (need to be) used to promote 
information utilization and school improvement? 

5. What are the barriers that impede improvement efforts 
in schools? 

6. How are information resources, linkages, and incentives 
combined to form a comprehensive dissemination capacity? 

7. What "entitlement'* does the dissemination agency have to 
provide services to its clients? 

8. How can clients p{\rticipate in the design of dissemination 
services? 

9. How does the legal/regulatory structure enable/inhibit the 
development of a service capacity? 



Encourage Diversity r ^? o t Sameness, in Addressing Common Objective s 

It is not true that collaboration and the compromise that is required to 
achieve it diminish creative approaches. Our experience indicates that 
multiple dissemination strategies and channels are needed. Wliat is required 
is that there be some deliberateness to the design of these channels to avoid 
unnecessary inefficiency. Note for example, that although each member in a 
symphony orchestra does not play exactly the same notes, the overall product 
is one of harmony and unity. 



Increase Incentives for Collaboration 

At this point, the disincentives to collaborative dissemination and 
utilization far outweigh the incentives, both in quantity and degree of 
impact. Disadvantages accrue directly to those network members who reach out 
to establish collaborative ventures; advantages accrue to the whole network. 
We need to establish meaningful rewards — recognition, special grants, 
leadership roles — to those network members who take the risks. 

These are some of the more significant principles we have learned and 
followed in our work with dissemination and utilization networks at all 
levels---national , state, and local. Based on these experiences, I do not 
doubt that pressures to improve the quality of our dissemination activities 
will be followed by greater ones to increase the efficiency of the vocational 
education network. Legislative requirements for evaluation of outcomes and 
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impact are signs of this pressure* Responding to these accountabi li 
mandates will require that we work together, or certainly we shall fail 
separately. The National Center for Research in Vocational Education, 
particularly the Dissemination and Utilization Program, provides all 
vocational education disseminators with an opportunity to realize greater 
coherence, efficiency/ and impact. Building on the strengths and 
accomplishments of the network members, the National Center appears ready and 
able to serve as an organizational framework in which the necessary 
compromises can be made. I will not say there are no risks, that there will 
be no losses. I do feel that the National Center represents the best window 
of opportunity yet presented to the vocational education community* 

Recent Experiences 

As a means of pulling together and illustrating my remarks, let me draw 
upon some very recent experiences we have had in working with various 
otganizations involved in supporting school improvement through dissemination 
and utilization services* Earlier this year, we COTipleted work on a design 
and small pilot test for a computer-searchable file of educational programs 
and practices. The work was done for the National Institute of Education 
(NIE). In our report to the National Institute of Education on recommended 
next steps, we suggested that their long-standing quest for increased 
collaboration and coordination among disseminators appeared to falter because 
the several agencies and groups involved lacked a forum or field in which each 
could contribute and in which each could realize benefits. We recommended to 
NIE that the collaborative development of shared resource files provided a 
low-risk, neutral area where the amount of necessary compromise was limited 
and the benefits were substantial. 

While waiting for NIE to respond to our recommendations, we have had 
numerous opportunities to test out our notion and to develop other activities 
to promote collaboration within some very diverse networks — teacher centers in 
New York State, federal and state programs in Nev/ Jersey, and organizations at 
the national level. Beginning with sound designs, we are using technology to 
support the ongoing exchange and the development of specific common agendas so 
critical to collaboration. In New York State, for example/ all federally 
funded teacher centers, with the support of the state education agency, are 
collaborating in the design and development of a comiron computerized file of 
programs, practices, and instructional materials. Using communication 
terminals, each network member can send and receive messages and contribute to 
an electronic newsletter developed just for their network. Notices of key 
activities, new resources, and needs are sent daily through the network and 
resources are exchanged among the centers. Not only are the costs of sharing 
minimal, the benefits in terms of a larger pool of resource materials and 
human and organizational resources are available to each member. 

In New Jersey the need to develop a coherent and organ! ^ed system for 
supporting school improvement activities has resulted in the development of 
several resource files and a much improved technical assistance delivery 

1 1 



mechanism. These developments are motivating a variety of state education 

agency programs to collaborate around the coc^aon agency mission of supportd.ng 

school improvement • Throughout the state, inracmediate agencies are rallying 

around the developing resource system as an iirrpetus for linking actual and 

potential network members. In New Jersey alsou we found the same needs- ^a 

relatively neutral activity on which to vi/ork collaboratively/ a means for cost 
effective exchange, and a way to make a unique contribution to a common goal. 

Conclusio ns 

We are not idealists in our view of cullaborative dissemination; such a 
posture is untenable in the schools of New York City, in the state education 
agenr;y in Trenton, or in Washingtoii ' s federal offices. No, we are not 
idealists* but we do have a vision. To realize the vision requires the 
courage to risk; nevertheless, thf- risks are manageable. To realize the 
vision requires the courage to compromise; however, integrity and uniqueness 
can flourish. 

In closing, I would like to offer you a challenge — in your deliberations 
here and in your future work — to take on the risks which are required to 
realize meaningful collaboration. To avoid these risks is to do nothing and 
to fail to capitalize on our experiences, strengths, and present opportuni- 
ties. 
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ORGANIZING FOR DISSEMINATION COLLABORATION 
(Presentation Notes) 



Four Important Questions 

1. What are we trying to achieve in our conduct of dissemination 
activities? 

2. How will collaboration contribute to this achievement? 

3. What impediments exist to greatei; col laborat ion in dissemination? 

4. What operational principles can we use as guides to the 
development of collaborative dissemination activities? 

Definitions 

Organizing: To give purpose, structure, and order to an activity. 
Organizing implies deliberation and design, not serendipity and 
happenstance • 

Dissemination: Four categories of activities: spread, exchange, choice, an<i 
implementation . 

Collaboration: To cooperate, to form a partnership or alliance for the 
conduct of activities. 



School Improvement Goals 

1- To be more analytical in identifying deficiencies 

2. To employ more comprehensive and high quality planning and 
development activities 

3. To use a greater quantity and quality of information resources in 
assessing and addressing problems 

4. To strengthen our clients' residual capacities to handle successfully the 
next problem that comes along 



Contributions of Collaboration 

!• A reduction in unnecessary duplication of effort 

2- An increased focus of a critical mass of resources for supporting school 
improvement activities 
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3. Easier arjcess by practitioners to information, resources, and tet.hnical 
assistance 

4. An increased impact on important indicators of system performance 

5. An increased ease in assessing such impact 

Inadequacies in Dissemination and Utilization Activities 

1. Inadequate attention to the client perspective 

2p Inadequate focus on specific school and student performance 
def iciencies 

3. Emphasis on the technical at the expense of design 
4* Creating client dependencies 
5, Failure to maintain continuity 

Impediments to Collaboration 

1. Impractical or vague goals for the collaborative effort 

2. Failure to accurately estimate the costs of collaboration 

3. Insufficient and inadequate incentives 

4. Inadequate technology for exchange and sharing 

Pr incij^le s for Co 1 labo ra t i ve Disseminat ion 
!• Identify differences and similarities 

2. Pay attention to the costs of not collaborating 

3. Establish inter- as well as intra-system relationships 

4. The whole is greater than the sum of its parts 

5. Establish a strong conceptual framework, then work on tactics and 
techniques 

6. Encourage diversity, not sameness, in addressing common objectives 

7. Increase incentives for collaboration 
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( Presentation Outline ) 



Daniel Dunham 
Visiting Scholar 
National Center for Research in Vocational Education 
The Ohio State Univesity 
Columbus, Ohio 
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COLLABORATION FOR PROGRAM IMPROVEMENT IN THE EIGHTIES 
(Presentation Outline ) 
Daniel Dunham 



!• Introduction 



A. Purpose of conference: to plan for D&U collaboration 
B» Array of participants and actors 

Importance of D&U selected products: 



1, Topical 

2* On target 

3. Dealing with special needs groups 

4« Assessing effectiveness 

5. Sex fairness 



II* New and Continuing Issues in the 1980s and 1990s 

A. A word about reauthorization, issues r and politics 

Major challenges are in areas of assessing effectiveness 
of vocational education programs, reaching and teaching 
special groups, proving the utility of R&D efforts, 
marketing results, and making new linkages with new groups 
of providers 



III, The New Collaborators 

A, We are entering a time of shared responsibility and shared 
oppo r t un i t y • 

We have not capitalized on the system — or potential system- 
that cxirrently exists 

C, It is exciting to have so many of the actors in one place 

!• Research Coordinating Unit personnel 
2* Curriculum Coordination Centers and network 
representatives 

3. National R&D experts 

4, Federal leadership persons 

D. The syst«n has great potential and viable parts 

1. National Center for Research in Vocational Education: 
Three clearinghouse functions (ERIC, National Center 
Clearinghouse, Resource and Referral Service), and 
other projects, products, and technical assistance 
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2. 



Other significant aspects of the system 

a) Curriculum Centers and networks 

b) Research Coordinating Units 

c) Other labs and centers 

d) National Diffusion Network 

e) National Occupational Information Coordinating 
Conunittee (NOICC) and State Occupational Information 
Coordinating Committee (SOICC) (yes, they are a part of 
It too : ) 

f) Community Colleges and American Association of 
Community and Junior Colleges (AACJC) 

g) Community -Based Organizations (CBOs) 

h) Military 

i) CETA, especially regional office technical assistance 
or management assistance (TA) systems under development 



3. All of these potential collaborators/participants raises 
some important problems and questions 

a) Knowing who to link with 

b) Knowing what to link (subjects, common clients) 

c) Assessing quality of products and services 

d) Learning how to adapt and adopt and replicate 
(especially at lower costs) 

e) Facilitating and enabling versus owning 

Addressing these questions and problems calls for some 
invention and creation 

1. Need to adopt a CLIENT approach; differentiated, 
tailored, individualized and synthesized 

2. Need t.o concentrate efforts in a few key states - or 
regions within states; build good, workable, low 
cost/high benefit models of dissemination and 
utilization... find out why and what makes them work, 

and then build some replication models second 

echelon or second generation steps, also requiring the 
investment of risk capital 

3. Need to develop a new cadre of leaders for dissemination 
and utilization— call them the "f acilitator/enabler" 
class of folks... the new change agents... the new 
COLLABORATORS. 
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**well trained 
**non-turf -ovmers 
**helpers and idea people 

^^knowledgeable about development, but not necessarily 
developers 

**orchestrators / who "know the score", and how 
to conduct without playing all the positions (mixed 
metaphor , albeit ) 

**those who know-- 

a) where to get materials and information for others 
and what's good and adaptable about it 

b) what the materials (or information) cost and how 
to replicate, ncL duplicate 

c) how to sort without screening (especially the new 
ideas 

d) how to be street level policy reformers 

Finally, a few notions about communicating, planning, and 
collaborating (audio visual presentation) 

Six Cs of Collaboration: 

1 • Contact 

2. Communicate 

3. Cooperate 

4. Coordinate 

5. Consolidate 

6 . Co 1 laborat e 
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CONFERENCE SESSIONS 



ERIC 



I. OVERVIEW 



Orientation to Dissemination and Utilization 

Joel H. Magisos and Norman M. Singer 
National Center for Research in Vocational Education 



New Selected Dissemination and Utilization Products 

(Outline of Presentation) 

Alta Moser 

National Center for Research in Vocational Education 



A« ORIENTATION TO D&U NETWORKS AND SYSTEMS 



Joel H. Magisos ana Noannan Singer 

A brief orientation to three systems was provided in this special 
session. TSie Educational Resources Information Center (ERIC) , National 
Diffusion Network (NDN) ^ and Research and Development Exchange (RDx) were 
described and D&U actors in vocational education were identified. 

ERIC is the national information system for education sponsored by 
the National Institute of Education (NIE) • It ls composed of sixteen 
decentralized substantive clearinghouses , a reference and processing 
facility / and a document reproduction service. The ERIC Clearinghouse on 
Adult, Career^ and Vocational Education at the National Center processes 
documents and joxirnal articles in our fields provides user services / and 
develops information analysis papers. Complete ERIC microfiche 
collections are located at more than 60 0 locations in the nation and 
computer search services are available at hundreds of locations. 

NDN is. a U=^S« Department of Education-sponsored system designed to 
help educators select and implement educational programs that work. 
Educational programs are selected for support in the program only if they 
have obtained approval from the cToint Dissemination and Review Panel 
(JDRP). NDN supports state facilitator projects which help educators 
locate/ select/ and implement programs with the assistance of developer/ 
demonstrators (projects fmded to assist with adoption of specific 
•JDRP— approved programs) . 

RDx is an NIE-sponsor ed network of regional exchanges located in regional 
educational laboratories. The regional exchanges/ supported by four 
central service contractors/ help local/ intermediate/ and state 
educational agencies locate appropriate R&D-based resources for solutions 
to educational problems- 

In vocational education/ a number of organizations and individuals 
are active in dissemination and utilization. The Curriculum Coordination 
Centers (CCCs) / funded by the U*S- Department of Education/ work with 
state liaison representatives (SLRs) from their respective state 
education agencies (SEAs) to coordinate cxxrriculum development and 
dissemination activities. Together/ the CCCs constitute the National 
Network for Curriculum Coordination in Vocational and Technical Education 
(NNCCVTE ) . 

in the state education agency (SEA)/ the Research Coordinating Unit 
tRCU) has responsibility for managing program improvement/ including 
research/ exemplary and innovative/ and curriculum development projects* 
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Some (SEAS) work through intermediate education agencies (Intermediate 
Service Districts^ etc*) to provide program improvemei*t and support 
services to I,EAs. Some SEAs operate, or contract for, on.- or more 
instructional materials laboratories ( IKLs ) or instructional materials 
resource centers (IMRCs), At every level there are organizational 
mechanisms for facilitating program improvement. Designated by a 
plethora of acronyms meant to speed communication^ these organizations 
each have a role and function. The challenge is to bring them into 
collaboration! 



Note: Details about any of these programs may be obtained from the 
sponsoring agencies, the host organizations, or the National Center's 
Dissemination and Utilization Program. 
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NEW SELECTED DISSEMINATION AND UTILIZATION PRODUCTS 



Alta Moser 



I. Overview of selection process 

A. Priorities of national significance 

B. Screening methods and sources* 

C. Reviewing via selection criteria 

D. Corroboration of field consultants 

E- Types of products selected (main considerations in addition to 
content ) : 

1. Size of audience vs criticality of need 

2* Variety of products which speak to same need to allow 
for differences in point of reference and individual 
teaching styles 

3m Writing style which allows for easy adaptation 

4, Usable and practical form and organization 

5, Apjpealing design and format 

6* Legal requirements met (bias free) 

7m Minimxim implementation of inservicing needed 

Fm Making products available — promotion and timing (allowing for re- 
prints)/ Interchange and Memo 

G* Status of promising productrs that are not selected for nationwide 
dissemination support — Memo listing under column "For Your 
Consideration" 

Solicitation of new products / especially for newer priorities such 
as energy and productivity 

II, Status of Product Selections 

A, Taking on Tomorrow and Working on Working (selected in July and made 
available in October) 



♦Elimination of products beyond the Screening stage results most often 
because they contain sexist or biased language or illustrations (in a manner 
that is difficult or costly to fix)^ or they are — 

^• In the form of a final report 

2. Too complicated for their intended use 

3* Poorly written, or 

4m Incomplete 
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B. New selections — availability information to be released as soon as 
it is finalized with developers/proprietors 



I 



III. Showing of Products 

A. Display of products (National Center and D&U) and catalogs 

B. Showing of "Working EquaT' videocassette (information shared on 
targeted mailing to SLRs and CCCs) 

C. Browsing time for all products 



IV. Some responses and reactions to D&U and National Center targeted 
mailings • 

A. SLRs should be included — ten out of twelve of them have some con- 
nection with or responsibility for state resource centers 

B. Included with targeted mailings should be information on how many 
other copies have been disseminated and to whom, and some ideas as 
:o purpose and intended use of the materials sent 



PRODUCTS IDENTIFIED 
FOR DISSEMINATION 



DKVELOPING 

AGENCIES/ 

PROPRIETORS 



PRIORITY TliEME/ 
FUNCTION 



USER CROUP 



EDUCATI . 
T.EVn. 



Teaching Disadvan tared Gtudentf: 



Puznied About Educating Special 
Needs GtudontG? 



Job Placerent, ^iupervision 
and roilow-Uo 



Western ^;tl^ylnnd 
Vocational Resource 
Center 



Wisconsin VocDtional 
Studies Center 



Ohio Department of 

Education, Division of 
Vocational Education 



V I 



X X 



.■'raF.rT From All 'fc-jr Ct. tionr: . . . 



Office Tor Equal Accerrs 

Nov/ Jercoy Department oi 
Education 
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PROBLEMS IN ORGANIZING FOR DISSEMINATION COLLABORATION 

SUMMARY OF FINDINGS 



Janice Adkins and Jaynee Foust 
National Center for Research in Vocational Education 
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PROBLEMS IN ORGANIZING FOR DISSEMINATION COLLABORATION: 

SUMMARY OF FINDINGS 



Janice Adkins and Jaynee Foust 

During sessions on Wednesday, November 12, 1980, conference participants in 
small work groups developed lists of comiron and unique dissemination problems* 
These work groups were divided according to state size: large, moderate, or 
small* Participants self-selected into work groups. The following is an 
analysis of the results, with percentages shown for the total group only. 

Total Group 

Pifty-three percent of the total group of the conference participants 
identified the "need for administrative commitment" as their most important 
dissemination problem (responses were requested in terms of participants' 
personal experience)* The second and third most important dissemination 
problems were the "need for dissemination and evaluation strategies as a part 
of initial planning" and the "determination of appropriate strategies." 

Large States 

Participants from large states indicated two items were of major concern. The 
"need for administrative commitment" and the "need for dissemination and 
evaluation strategies as part of initial product development planning" were 
rated as most important by 45 and 43 percent respectively. 

Moderate Sized States 

Sixty-six percent of the participants from moderate sized states identified 
the "need for administrative commitment" as their most important dissemination 
problem. Further analysis of mean scores and upper level ratings revealed 
that "quality control for content and format of products" as well as the "need 
for dissemination and evaluation strategies as part of initial product 
development planning" were important dissemination problems. 

Small States 

The small states sample was too small to draw definite conclusions from, 
except that all agreed on "allocation of scarce resources" as the most 
important dissemination problem. This was the only group indicating an 
overriding concern for financing of dissemination efforts. 
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TEN MOST COMMON OR MOST SERIOUS DISSEMINATION PROBLEMS 
IDENTIFIED BY SMALL GROUPS 
(During sessions on Wednesday, November 12, 1980 



Summary of Results for Total Group 

Least Most 

Mean Important Important 

Rating % % % % % 

3,49 1. Allocation of Scarce Resoxirces 4 17 28 28 23* 

3*43 2. Quality Control for Content 9 17 15 32 21 

and Format of Products 

4.11 3. Need for Administrative 4 9 13 19 53 

Commitment 

3.51 4. Needs Assessment 6 9 23 13 23 

3.61 5. Consensus Regarding Roles 6 9 19 49 19 

and Responsibilities of 
Dissemination Collaborators 

3.93 6. Need for Dissemination and 9 21 36 32 

Evaluation Strategies as. 
Part of Initial Product 
Development Planning 



3.89 7. Determination of Appropriate 6 30 26 

Dissemination Strategies 
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3.56 8* Need for Effective Communi- 4 6 26 30 30 

cation Networks at All 
Levels of Collaboration 

3.44 9. Collaborators' Attitude 4 17 21 38 15 

Toward Change 

2.58 10. Proprietary Feelings 19 28 '30 13 6 

Toward Products 



♦Totals do not always add to 100% because of rounding effects and because all 
participants did not rate every item. 
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Ill* IDENTIFICATION OF PROMISING DISSEMINATON PRACTICES 



Carol P* Kowle and Shelley Grieve 
National Center for Research in Vocational Education 



IDENTIFICATION OF PROMISING DISSEMINATION PRACTICES 

SUMMARY OF FINDINGS 



Carol P. Kowle and Shelley Grieve 

During work sessions on Thursday, November 13, 1980, conference participants 
suggested lists oF x:)rotnising practices. The following is a summary of the 
suggested practices listed. 

I. Establishment of communication networks, both in-state and 
out-of-state 

A. Contiguous states should share services and contract with each 
other for services- 

B. Vocational educators should tie in with the National Diffusion 
Network (NDN) to use an existing system for their own benefit. 

C. Linkages can be established with school counselors at the local 
level . 

D. Dissemination personnel can work with program area specialists to 
identify teachers as linkers at the local level. 

E. Dissemination personnel should establish linkages with local 
vocational education directors. 

F. Establishment of a state/regional library loan system can aid 
statewide or regional dissemination of materials . 

G. Development of a communication network to share information from 
the local to the state level and vice versa can be accomplished 
through the use of newsletters and bulletins. 

H. A statewide clearinghouse can be established to promote access to 
materials on a cost recovery basis* 

II. Development of Exemplary Program or Models 

A. Dissemination personnel might wish to use developers in 
workshops/conferences to demonstrate the program or products they 
have developed. 

B. Demonstration sites can be used to encourage adoption of prosnisincj 
practices and programs. 
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III. Encouragement of Professional Development Activities 



A. One sucjgGStion is to offer university credit/certification credit 
for teacher participation ii professional development activities 
relating to dissemination c* programs and practices. 

B. Requiring a ccinmitmont from potential users to attend workshops 
can encourage greater involvement of those users in the 
dissemination process. 

C. Another promising dissemination technique is the use of a 
statewide vocational education conference, where programs and 
products are discussed. 

D. Collaborating with other professional meetings was suggested as a 
means of widening the circle of disseminators. 

E. A statewide dissemination conference ^ coupled with a publication 
including abstracts, final reports, and contact persons, can 
encourage statewide collaboration. 



IV. Working with Collaborators at the Local Level 

A. An orientation program for new teachers should include the 

opportunity for "hands on" experience with promising curriculum 
materials* in order to encourage these teachers to buy/use t)\e 
materials . 

B* Use of teacher educators in preservice and i nservice training] can 
encourage them to become a part of the statewide disseminaton 
system. 

C. Local input into the needs identification process can be 
accomplished through linkages with program supervisors. 

D. - Recognition should be given to the local education agencies and 

t-.eachers which have implemented promising practices and products. 

E. Local developers should be encouraged to maintain information 
links with their state departments, to guarantee that state 
department personnel are up to date on programs and products. 

F. The team approach to dissemination at the local level can be 
ef feet ively implemented by using administrators , teachers , 
counselors, supervisors, and staff level personnel* 

G. State level dissemination personnel should assist local education 
agencies in establishing goals and designing programs to achieve 
their goals using materials being disseminated statewide. 
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A. 



B, 



V. Use of Monetary Incentives 

" L^Lt:^ :'„e^"°.^:;ii/^" ^° --'^^^ -^-s who 

VI. Review/Screening of Materials 

outcome, -succes'Lri^^Lwnn?"^'^'^ °^ "^'"^^^^ ^ - 

Potential users can and should be reviewers of r,v-^^ ■ 
and products. reviewers of premising programs 

VII. Use of Media or Resources Centers 

r^^trtu^ior?"^ ^tabUshea at teacher ea-v-ation 

VIII. BuilciLng in Dissemination Plans 

A. All projects should build in dissemination pi 



A. 



B. 



on 



ans • 



B. RFPs (Requests for Proposals) can be 



semination plans. 



a source of suggested dis- 
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IV. EXEMPLARY DISSEMINATION PROGRAMS 



Vocational Education Dissemination in Oregon 

Nancy Hargis 
Resource Specialist 
Career and Vocational Education 
State Department of Education 



Dissemination/Diffusion in Florida : 
Hie Role of the State Education Agency 

Ma r gar e t Fe rque ro n 
Pureau Chief 

Vocational Research, Dissemination r and Evaluation 
State Department of Education 
Florida 



Dissemination Prograia for Vocational Education in 

Pennsylvania 

Erma Keyes 
Director 

Vocational Education Infoirmation Network (VEIN) 

Pennsylvania 



A Dissemination Plan that Works: Oklahoma 

Robert Pat ton 
Coordinator 

Curriculum and Instructional Materials Center 

St il Iwater , Oklahoma 
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VOCATIONAL EDUCATION DISSEMINATION IN OREGON 



Nancy Hargis 

Information dissemination for vocational education in Oregon is a 
multidimensional process which involves a variety of state^ regional, and 
local personnel. Dissemination processes must take into account geographic 
f actors-^great distances, a mountain range which bisects the state-'^and 
demographic data. Oregon's population is concentrated in a three^county area 
in the northwestern portion of the state. A small area in eastern Oregon is 
in a different time zone than the remainder of the state. Sparse population, 
small schools, and limited resources typify most of the eastern part of 
Oregon » 

Organizing and operating a dissemination system which addresses these and 
other significant variables such as the location of vocational progrcims is a 
challenge to planning, requiring flexibility and creativity • A variety of 
delivery modes must be utiliaed to meet the diverse information needs of 
Oregon's vocational educar.ion conanunity. 

Oregon's dissemination network includes five primary components: 

1. The Career and Vocational Education Section within the Department 
oi Education (thirty-one staff members) 

2« Personnel Development Centers (located in Portland and Eugene) 

3. Oregon State University ( resxxjnsible for vocational teacher 
education) 

4. Regional coordinators for caro a vocational education 
(sixteen located in education service districts throughout the 
state) 

5. Local vocational directors and teachers 

The delivery of information services flows through these system 
components • The regional coordinators play the most pivotal role in the 
system, providing a critical linkage between state and local personnel. At 
their monthly meetings, the coordinators are bombarded with information 
essential to teachers and local directors. Ccxnmunication is two-way, however, 
as coordinators bring local concerns and priorities to the attention of the 
state staff and share projects, activities, and problems with each other. 

Many traditional modes of dissemination are used in Oregon's dissemina- 
tion system. Print media abound, with newsletters, newspapers, and memoranda 
in the mail almost on a weekly basis* Catalogs of resources available from the 
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Department's collection of locally-produced career and vocational education 
materials are distributed throughout the state. A compendium of promising 
practices includes approximately seventy-five validated listings in career 
and vocational education. A comprehensive educational resource notebook is 
currently being printed ^ with regional introductory workshops planned for 
January 1981. Product displays are prepared for conferences of a variety of 
professional associations, both within and without vocational education. 
Dissemination staff meet with college and university teacher education classes 
and participate in local and regional inservice sessions. 

Needs sensing within each of the system components has assumed increased 
importance as the state has recently redifined and expanded its role in 
vocational dissemination. Although a wide disparity is frequently perceived 
to exist between national, state, and local priorities, the needs sensing 
activities conducted in Oregon during the past six months revealed a high 
degree of congruence among the three levels. 

Services for special needs groups, for example, are a national priority 
and the most commonly listed concern by regional coordinators. Planning and 
evaluation are also common priorities at the national, state, and local 
levels. Analysis of these priorities allows the state to address needs 
proactively, constantly identifying new resources and making them available on 
a targeted basis. 

The diffusion of promising practices in career and vocational education is 
stimulated by awarding small (up to $5,000) grants to regional coordinators 
for investigation and planning, and adoption/adaptation of selected practices. 
The catalog of promising practices had very limited impact on local adoption 
until these financial incentives were made available.. 

Oregon's dissemination system for career and vocational education is 
evolutionary — and possibly revolutionary — in nature* It must be responsive to 
information needs from all of its components and to anticipate priorities and 
areas of concern. The improvement of secondary and postsecondary vocational 
education programs — its ultimate goal--will continue to shape the system 
during the coming decade. 
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DISSEMINATION/DIFFUSION IN FLORIDA : 
THE ROLE OF THE STATE EDUCATION AGENCY 



Margaret Fergueron 

The Biireau of Research, Dissemination, and Evaluation in Florida is 
currently engaged in sponsoring projects and activities to improve instruction 
in vocational education programs in the state. These activities have produced 
and will continue to produce large amounts of materials. Increased 
production, distribution , and storage capacity are needed to deliver this 
educational material to intended users. 

A high priority of the Division of Vocational Education is to expedite the 
development of the system for reproducing, packaging, distributing, and 
diffusing products as a way to improve vocational education throughout the 
state. A goal of the Division is to design, implement, and maintain a system 
for infusing proven educational products, processes, and procedures into 
progreuns throughout the state for students, teachers, and administrators in 
all vocational education programs. 

The Division of Vocational Education is committed to the support of 
planned programs of development for new curricula and revision of existing 
curricula as a strategy for effecting constructive educational change. 
Dissemination is a process of providing products, procedures, and practices to 
targeted groups of educators. The process includes the elements of user 
identification and distribution* Diffusion is a process of providing 
educators an opportunity to explore, test, and make decisions to accept in 
whole or, in part, the products, procedures, and practices shown to have value 
for expansion and improvement of educational programs, practices, and 
services^ 

The Director, Division of Vocational Education, felt these activities were 
important enough to warrant a section which would be devoted full-time to 
dissemination/ diffusion planning. At thiu point, a brief description of the 
Dissemination/Diffusion Section's functions may enhance yoiu: understanding the 
Florida Dissemination/Diffusion Process. 



Dissemination/Diffusion Section Functions 

The purpose of this Section is to develop and maintain a statewide system 
of dissemination and diffusion as a means of improving vocational education 
t^hrough the use of proven products and procedures. The following functions 
must be performed if the purpose of the Section is to be achieved: 

1. Develop a dissemination/diffusion system that will appropriately 

involve representatives in the Research and Development Section; area 
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3. 



4. 



5. 



6. 



7. 



8. 



9. 



10. 
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offices; bureaus and sections; the Department of Education Research 
and Development Office; universities; community colleges; school 
districts; and the CJ.S. Department of Education, as necessary to 
develop plans for reproducing, packaging, distributing, and diffusing 
materials and processes developed through funded vocational projects 
needed in the improvement of vocational education • 

Develop, with the assistance of directors of funded projects # 
descriptions of benefits, costs, and organizational arrangements 
needed to utilize the products and processes being developed. 

Develop, with the assistance of project directors, educational 
consultants, local educators, and other appropriate persons, a 
description of the needs of potential users of the procedures and 
proces ses to be di s seminated and di f fused • 

Develop, with the assistance of educational consultants from the 
Department of Education, local educators r and other appropriate 
persons, a description of advocate roles to disseminate and diffuse 
the product or process* 

Select and state obtainable objectives to be achieved in the change 
process in terms of providing user groups an opportunity to: (a) 
become aware of products and processes useful in solving their 
problems , (b) make in-depth explorations into elements of the 
advocated change having direct interest to them, (c) use the advocated 
product or process in a limited way as a basis for evaliiating the 
benefits to their problems, and (d) accept or reject, in whole or in 
part, the product or process being advocated. 

Develop cost-effective methods for reproducing, packaging and 
distributing the products and processes to be diffused* 

Develop strategies and activities to achieve each objective for each 
user group served. 

Develop time, sequence charts, and budgets for each strategy and 
activity. 

Manage the implementation of each strategy, using educational 
consultants available in the area offices as facilitators and provide 
additional human and material resources through grants. 

Develop and conduct, with assistance from educational consultants in 
area offices and staff in the evaluation section, an impact study of 
the diffusion plan as a basis for providing information needed in the 
evaluation and possible revision of the plan. 




11. Develop and present interim and final reports of the dissemination and 
diffusion plans to appropriate personnel in the Bureau of Vocational 
Programs and the Bureau of Staff Development, Planning, and Budgeting, 
the Division Director's office and other offices within the State 
Department of Education- and the U.S. Department of Education. 

12. Prepare and submit a long-range and annual budget for dissemination 
and diffusion plans for inclusion in the Bureau budget. 

13. Monitor funded dissemination and diffusion projects to determine 
successes and problems in operating the plan and to correct 
deficiencies • 

14. Establish working relationships with organizational units within and 
outside the U.S. Department of Education having dissemination and 
diffusion responsibility as a basis for eliminating unwarranted 
duplication of effort, to keep informed of pertinent developments and 
to share resources. 

15. Review and recommend needed changes in policies and procedures for 
dissemination/dif fusion of vocational education improved products and 
processes • 
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DISSmiNATION PROGRAM FOR VOCATIONAL EDUCATION IN PENNSYLVANIA 



Erma D. Keyes 

The original purpose of VEIN/ the Vocational Education Information Network 
for Pennsylvania / was to facilitate access to R&D information by vocational 
educators* Its initial strategy has the same orientation today — dissemination 
for people rather than of products. In this context/ the strategies effected 
are to meet vein's service audience requirements for information than can be 
used. The operationzd. goal is to maintain efficient service at reasonable 
costs — what the sponsoring system can bear — while satisfying service users. 

Although vein's service audience now includes all persons involved with 
the design/ development/ management/ operation/ and evaluation of vocational 
'programs in the state/ some specific smaller groups were earlier targeted. 
They included directors of area vocational technical schools/ central and 
•regional state vocational education staff S/ vocational teacher educators, and 
state funded project staff s. The members of these groups showed som^i conmon 
information use characteristics. They needed information for specific 
problems; it was usually requested from an outside service only after exhaus- 
ting fcuniliar and personal sources; it came from fugitive resources with low 
visibility and often difficult to obtain / and it was frequently used to verify 
or clarify personally derived positions on matters requiring decisions which 
would affect vocational education activities due to leadership status and 
role . 

The Research Coordinating Unit (RCU) fulfilled its dissemination fxinction 
by awarding grants and subsequent contracts to Millersville State College to 
design and operate the dissemination service which has been known since 1970 
as VEIN* It was decided that the ERIC and AIM/ ARM data bases offered the best 
solutions for meeting the information needs of the selected target groups 
since the resources were organized for easy retrieval and could be quickly 
duplicated in readily usable formats — microfiche and paper reprints — to effect 
prompt delivery in response to request. The acceptance of microfiche copies 
was enhanced by "piggy-backing" with simultaneous efforts of another 
vocational education project and an NDEA funded activity to place microfiche 
reader-printers in all schools for student and counselor viewing of an 
aperture card series on occupational information ( PENNscripts) . 

To increase awareness of the service and to ensure its value to vocational 
education/ VEIN staff members contacted potential users at their educational 
agencies/ conferences/ workshops/ group meetings/ and by telephone. These 
contacts were invaluable for determining interests and needs of the target 
audience. Administrator requests for local school teacher orientation sessions 
broadened the audience at a pace which VEIN staff could still service within 
the elected parameters for user satisfaction. 
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A DISSEMINATION PLAN THAT WORKS: OKLAHOMA 



Robert Pat ton 

Dissemination — a simple word, but when put in practice, it becomes 
extremely difficult to carry out. Everyone has their own method and plan for 
dissemination* 

Basically/ dissemination can be thought of in two senses: (1) 
dissemination of information and (2) dissemination of products. Vocational 
educators are busy people, and in some instances, they are too busy to do a 
good job in disseminating products. 

Prior to the 1976 amendments, dissemination of vocational education 
products was freqxiently handled in an unsystematic manner. Developers of 
various products chose one or more of a variety of routes in attempting to get 
their products into the hands of potential and intended users (e.g., entered 
them in the ERIC system, mailed a copy or copies to state vocationaLL 
directors, sent them to Curriculum Coordination Centers, and Research 
Coordinating Units) . 

In too mcmy cases, the potential success of product dissemination was 
aborted at the desk of the receiver of the product. This was particularly 
true in our state. People had a tendency to collect items in their individual 
offices without any means of getting the information out to other potential 
users . 

Following participation in a "field agent project" wJ.th the National 
Center for Research in Vocational Education, the State Department of 
Vocational and Technical Educcition in Stillwater, Oklahoma began a concerted 
effort to implement an effective state dissemination system. Basically, the 
plan capitalizes on three groups of individxials who have historically handled 
dissemination functions: RCU directors, state liaison representatives (SLRs), 
and program supervisors. Itie plan instigated a coordinated effort to create 
awareness of new products among state staff members and to get selected 
products into the hands of appropriate users. 

The SLR, RCU director, and the state department librarian formed a State 
Dissemination Coordination Council (SDCC) to oversee the operation of the 
state dissemination plan. Their primary focus is on those products of 
"national significance" as identified by the National Center for Research in 
Vocational Education and/or products that are distributed in multiple copies. 

Initially, SDCC selected (with the help of key state department personnel) 
a review team or an advisory council for dissemination. The team is composed 
of teacher educators, teachers, fxmctional specialists, occupational 
supervisors, selected administrative staff, and representativ.:iS of all 
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occupational areas. A meeting was held to outline the scope, procedures, and 
advantages of the dissemination project. 

The following procedures were explained. One copy of each publication is 
cataloged into the State Department Reso\irce Center to becoipe a part of the 
collection and be available to any Oklahoma vocational educator. other copies 
will be distributed to review team members having expertise in the area 
related to the product. For example, a health teacher, a teacher- educator in 
the health services area, and the health programs supervisor would each 
receive a copy of curriculum materials for the occupation of biomedical 
technician. The copy is theirs to keep, but they need to evaluate it (in 
writing on an appropriate evaluation instrument) so that recommendations can 
be made to key decision makers. 

After the evaluations of the review team members are collected and 
tabulated by the SDCC, one of three options can be recommended; (1) terminate 
product consideration because it is inadequate to meet state needs or there is 
no need in state; (2) obtain additional information on the product (e.g., how 
is it being used in other settings, talk with developers, evaluate cost 
factors); and (3) place the product in a field test mode. 

Emphasis was placed on their participation in evaluating materials as 
being a valuable link in directly affecting program improvement in Oklahoma. 
It was pointed out that the nvurJber of products each would be asked to evaluate 
during a year would be minimal and probably would not exceed two. 
Furthermore, any materials they would be asked to evaluate would deal directly 
with their subject area or would be of such a nature that it could be applied 
to program improvement in general. Members of the SDCC do not make final 
decisions or censor any products. Father the RCU director, SLR, and librarian 
pool resources to create awareness of new products, jointly coordinate the 
direction of a given product, collect and evaluate feedback, and report to key 
decision makers. 



No vocational program can exist if it does not change. Without the 
vitality which successful innovations bring to the vocational education 
system, the system would surely show a decrease in its effectiveness. The 
purpose of the Oklahoma Dissemination Plan is to ensure that the correct 
information is available to decision makers at the right time. By asking more 
people to become involved in the dissemination activities, chances are 
increased of getting new products in use at the local level. 
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V. DEVELOPING COLLABORATIVE DISSEMINATION AND UTILIZATION PROGRAMS 



Rebecca Douglass 
Director 

East Central Curricul\m Coordination Center 

and 

Cotfficil Chairperson 
National Network for Curriculum Coordination in Vocational 

and Technical Education 



Nancy Hargis 
Resoiarce Specialist 
Career and Vocational Education 
State Department of Education 
Oregon 



Janet Treichel 
Visiting Assistant Professor 
Department of Vocational and Technical Education 
University of Illinois at Champaign-Urbana 
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THE NATIONAL NETWORK FOR CURRICULUM COORDINATION AS A COLLABORATIVE 

NETWORK 



Rebecca Douglass 



The National Network for Curriculum Coordination in Vocational and 
Technical Education (NNCCVTE) can be considered a "collaborative" in its 
own right; however, it functions as an actor in the developing nationwide 
D&U system for vocational education. The NNCCVTE and its six cxirriculum 
coordination centers can be considered a "focused collaborative" with 
emphasis on vocational education curriculum development, dissemination/ and 
utilization concerns • 

The NNCCVTE and its centers were originally funded by the federal 
government to disseminate curriculum and serve as facilitators and 
coordinators of curriculum information and materials among the states- 
Each region has its individual scope of work determined by the state 
liaison representatives (SLRs) of each region in addition to general 
network goals* 

The NNCCVTE is successful because of its collaborative nature 
allowing- 

°no mandate for participation 
^no direct exchange of dollars 
^no threat of non-compliance 
°serv ice-oriented nature 

The levels of collaboration activity include national, regional, state, and 
local. The centers foster inter- and intra-regional cooperation with the 
following groups as examples: 

^U.S, Department of Education — input priorities, dissemination of 
federal outcomes, inservice 

^National Center for Research in Vocational Education--input to 
selection criteria, dissemination of products and information 

^Professional associations — AVA Exemplary Energy Materials and Programs 

^Professional curriculum organizations — Vocational-Technical Education 
Consortium of States (V-TECS) , American Association for Vocational 
Instructional Materials (AAVIM) Energy Consortia, etc. 

^Publishers, business, and industry — marketing function and information 



to LEAS 
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^Information networks and databases — input and access regarding 
vocational curriculum 

The center networks aid states in serving local programs as: 

1. A clearinghouse for curriculum information 

2. A resource for materials 

3. A synthesizer of curriculum-related issues 

4. An assistant to developmental concerns 

5. An extra hand in the implementation process 

6. A facilitator of curriculum professional development 

The network functions will work because of continuous/ free-flowing 
communication among the regions and states, and ongoing sharing of materials 
and ideas in relation to curriculum development, dissemination, and 
utilization in a nonthreatening and cooperative way. The results are 
increased adaptations, better quality materials, better availability of 
information, increased state-level services, and cost savings. 
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COLLABORATION — SERENDIPITY OR CONTRIVANCE? 



Nancy Hargis 



There are a multitude of issues that must be addressed as one plans 
collaborative ventures* They can be condensed into three basic questions 
which serve as the framework for this discussion of planning for 
collaboration . 

1 • What is collaboration and what are its effects ? 

Collaboration is a complex and multidimensional process which involves 
the conscious decision of two or more agencies , institutions / or 
groups to combine resources for the attainment of commonly held goals. 
Collaborative arrangements are generally established to attain long 
range goals of change within a social system. Collaboration involves 
potential risks to both individuals and the institutions they 
represent* Fail;xre of a collaborative venture is often a highly 
visible solution • 

Collaboratives are characterized by flexibility, creativity, and 
energy among their members. Participation in a collaborative 
arrangement can broaden the scope of possible solutions to problems 
and reduce the limitations of bureaucracies if collaborators have 
adeq\iate decision-making authority. 

2 • Is collaboration a serendipity event, a chemical reaction/ or plotted 
behind closed doors ? 

Collaboration can be voltontary or mandated, spontaneous or planned in 
advance and engineered/ at least in its beginnings. The most 
successful and effective collaboratives, however, appear to have 
grown from chemical reactions in which a chance set of conditions or 
circumstances served as a catalyst for their development. 

Agencies or institutions with common goals and unsolved barriers to 
their attainment come together at a point in time when both perceive 
and accept the mutual benefits of working together in a structured 
manner. As goals and barriers are discussed and analyzed, a plan of 
action is developed in which all parties contribute to and receive 
from the collaborative effort. Because each member of the group now 
has access to new resources from other members, clients are better 
served, and the goals of all are more readily attained. 
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Is collaboration important to vocat-ional education in the 198Qs 7 



Collaboration is not only important, it is essential for vocational 
educators across the country to work more closely together as 
financial resources diminish and demands for accountability increase • 
The decision that remains involves identifying agencies, institutions, 
associations, and other groups wlio share common goals and concerns 
with vocational education and cementing collaborative ari-angements 
with selected "kindred souls." 

Successful collaboratives for program improvement in vocational 
education will stimulate energy and creativity among all members- The 
synergy created by collaboration will bring new resources to 
classrooms, labs, and shops that might otherwise not reach those most 
in need. Ml students can have access to high quality vocational 
experiences as a result of collaboration among local, regional, state r 
and national agencies and institutions. 
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DEVELOPING COLIiABORATIVE DISSEMINATION PROGRAMS^-A UNIVERSITY PERSPECTIVE 



Janet Treichel 

The inadequacies of dissemination efforts have been written about by many 
who have been studying dissemination in recent years. It is accepted that 
dissemination needs to be more systematic, that it needs to be a coordinated 
effort of all actors (funderS/ developers, linkers, and users), that there is 
a need for a national dissemination system such as the one being developed by 
the National Center for Research in Vocational Education, and that there is a 
need for coordinated and collaborative dissemination systems at the regional 
levels. However, as Oliver (1980) states, dissemination programs which 
effectively reach the practitioner level are largely a state responsibility. 
The identification of dissemination as a high priority is essential and must 
be supported financially by the state or even the national efforts will fail 
to achieve tneir maximum potential. 

The mere dispersing of concepts, materials, or information to educators 
does not assure utilization nor does it necessarily effect change in any way. 
Not enough is known about how and what kinds of R&D products persons select 
for use, the purpose for which they are used, the impact and effectiveness of 
their use, or how the interest is engendered initially. All too often the 
successes of funded programs are termed failures at the stage of local level 
implementation because they do not necessarily achieve the intended outcomes 
as stated by the f under and developer. However, the difference between the 
goals of the fi:inder and developer and the local implementation goals do not 
necessarily represent conflict but a realization that there are varying local 
needs to be met through program implementation (Farrar, DeSanctis, and Cohen 
( 1980). Tlie way across the bridge from theory to practice is a tedious one 
requiring adaptations and special considerations for the xiniqueness of 
individual local school districts and for varying program goals. 

The State of Illinois Research Coordinating Unit (RCU) contracted with the 
University of Illinois to develop a model for dissemination which would 
facilitate cooperation and collaboration among all who are involved in the 
dissemination process: research and development agencies (funders); 
innovators of new materials, project planners, and developers (developers); 
f aci litfitors that link products with appropriate persons (linkers); and local 
practitioners who will use the information, materials, reports, or services 
(users). The proposed model also focuses on intended outcomes and addresses 
the identification of strategies and techniques which facilitate the movement 
of products into the educational milieu, thus maximizing impact assessment of 
R&D ef forts and resulting program improvement • 

The dissemination project became the third component of a university-based 
research effort to address the need for a comprehensive R&D management and 
assessment program in the state* The first component was funded to develop a 
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system for planning, facilitating, monitoring, utilizing, and evaluating R&D 
activities in the state. This program has assisted in the identification of 
R&D needs, and developed and implemented a plan for priority setting. The 
second component has focused on assisting the state RCU in developing an 
impact specification, monitoring, and assessment system. The third component 
has addressed the need for development of a systematic dissemination system 
for R&D funded outputs. The university setting has provided for collaboration 
and cooperation among the three programs in the conceptualization process, 
testing, revision and refinement efforts, and implementation. Specific 
attention is given here to the direction being given to the dissemination 
system. 

To achieve consensus regarding the term "dissemination", how it was being 
used, and the implications of that use, the Dissemination Analysis Group (DAG) 
def inition of spread , exchange , choice , and implementation was adopted 
(Fletcher, et al. 1977). This then began to provide so struct\ire to 
dissemination activities and the expected levels of ^sistance to be provided. 

The dissemination system is being developed in large part on the strengths 
and established activities of groups and agencies already existing in the 
state. Illinois has: a number of networks/agencies which engage in edv::ational 
dissemination to local school districts. Each network/agency has a number of 
regions, the boundaries of which are incongruent. There appears to be minimal 
coordination of these networks/agencies and local educators appear to have 
limited knowledge of the services provided by them. Thus, the University of 
Illinois has taken an active role in coordinating the dissemination services 
of these systems and increasing the practitioners* awareness of the networks 
and ways in which the networks can facilitate the dissemination of program 
improvement products to impact on instruction and programs for students* 

The dissemination system begins with four assumptions as prerequisine to a 
viable dissemination effort: 

1. Need demonstrated to develop R&D output 

2. R&D output of tested high quality 

3. Coordination and cooperation among all involved in the dissemination 
process: funder, developer, linker, and user 

4. Dissemination constitutes a set of , activities tthat span the life of a 
project and beyond and are not limited to "end of project activities" 

When the above assumptions are valid, one must ask, "Wliat is to be 
disseminated?" The R&D output must be classified as to whether it is general 
information, a report, a supplementary or resource aid, a tangible education 
product, or an intangible idea. This implies that different outputs require 
different amounts of dissemination effort depending upon the intended 
dissenni nation effect to be achieved. 



58 



What is the intended dissemination effect that is desired for tie output? 
A match of the R&D output with the appropriate assistance level of the DAG 
definition is determined. Is the intended effect that of "spread/' which 
would assist the target audience in becoming aware of the output and its 
conten-Ls? Is the intended dissemination effect "exchange," which would assist 
the target audience in Understanding the output and how it could be used? Is 
the intended dissemination effect "choice," which would assist the target 
audience in deciding whether or not to implement the output? Or is the 
intended dissemination effect "implementation," which would assist target 
audiences in implementing and continuing to use the output? 

What are the strategies that will help attain the intended dissemination 
effect in accordance with the level of assistance required? if the effect 
required is one of "spread" then outputs might be advertised in brochui'es, 
newsletters, journals; the output might be submitted to ERIC; or materials 
might be made available on a loan basis through library systems. If the 
desired dissemination effect is one of "spread and exchange" then the 
strategies might be expanded to include availability of output on a cost 
recovery basis; demonstrations at conferences/workshops; user panels at 
conferences/ workshops; matching output to local needs; coinmunication between 
producers and users; or examination/ complimentary copies. 

What techniques or "best practices" can be identified and implemented to 
carry out the strategy? Such techniques must be individual to the strategy, 
the actors involved, the output being disseminated, the audience, availability 
of time, funding, and resources* 

Wl-iat is the "re-^l dissamination effect" and how can it be assessed? This 
is accomplished through (1) short-term follow-up of a particular strategy, and 
(2) long-term folxcw-up of the dissemination plan. The short-term follow-up 
evaluates formatively the fulfillment of the audience expectations and employs 
accountability procedxnres. Summative evaluation assesses the attainment of 
the intended dissemination effect and also unexpected results. The long-term 
follow-up formatively evaluates the process throughout each component and 
summatively measures the impact, including xinexpected outcones through case 
study, survey analysis, outside evaluators, interviews, etc. 

Cooperation and collaboration among all actors becomes essential as the 
system is employed and the logistical questions are addressed: Who is 
responsible for dissemination planning? Who is responsible for putting each 
component into action? When does dissemination planning take place? When 
does each component get put into action? 
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VI . DEVELOPMENT OF PLANS FOR 
DISSEMINATION AND UTILIZATION COLLABORATION 



Participants were assigned to work groups on Thursday, November 13, 1980, in 
order to develop personal plans for dissemination collaboration. Each 
participant was encouraged to share needs for information or materials. 
Others in the group then volunteered resources to meet the needs identified. 
Thus, through collaboration during the actual work sessions, participants in 
many cases located the resources they needed. In the last section of their 
collaboration plans, participants listed the steps they intended to take to 
improve their own or their organization's dissemination capacity « 
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FIVE EXAMPLES OF COLLABORATION PLANS 



PLAN !• Wells Warren / Alabama 

PLAN 2. Valerie Pichanick, Connecticut 

PLAN 3^ Margaret Ferqueron^ David McOuat, 
Harold Cramer , Florida 

PLAN 4. Alyce Williamson r Kansas 

PLAN 5. Carol Sanders / Illinois 
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PLAN 1 
Wells Warren 
Research Coordinating Unit 
Alabama 



Needs 

1. Written dissemination plan 
Examples of different plans 

2. Names of D&U specialists - a 
directory to use in contacting 
persons with this responsibility 
in other states 

3. Need for examples of RFPS 
addressing an effective / 
workable needs assessment 

4» Set of specifications for 
curriculum materials 



5* Locally-directed evaluation 



6. Teaching techniques and strate- 
gies for working with the 
handicapped 

7. Service area newsletters 

8. Software (diskettes) for a 
microcomputer to retrieve 
voc ed materials 

9. Educational television use in 
vocational education 



Resources 

1. Florida, Illinois/ 
Ok lahoma 

2. 

(nothing indicated) 



3« Michigan/ National Center 
for Research in Vocational 
Education 

4. Georgia's model/ 

specif ications and 
guidelines for Vocational 
Education Curriculum 
Development 

5. Georgia (Post secondary 
Inst. ) ; Michigan , North 
Carolina (Equity ) 

^* (nothing indicated) 



7. Florida, Oklahoma 
B* Hawaii 



9. Florida 
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PLAN 2 
Valerie Pichanick 
State Department of Education 
Connecticut 



Needs 

1. Materia::s for use by Vo Tech 
Hispcmic classes 

2. Special Education-tasks 
according to ability 



3. Updated curriculum materials 

4. Identified educational needs of 
adults 

5. Evaluation of the effectiveness 
of programs 



6. Outreach to voc ed teachers 

?• Effective ccxnmvinication 
with employees and 
commun ity~based organ iza tions 



1. 



2. 



3. 



Resources 

Florida catalogue-Mary Buie 
Texas slide-stapes -Pat Lindley 

Ohio is developing — Tom 
Hindes Instructional Materials 
Laboratory , Ohio State 
University 

(nothing indicated) 



^ (nothing indicated) 



g (nothing indicated) 
(nothing indicated) 



-7^ (nothing indicated) 



Next Steps 

!• Develop intra-state cooperative by using available manpower: consultants 
and specialists to reach teachers in the field 

2. Build in dissemination/utilization in all programs and collaborate with 
guidance and personnel units to provide inservice dissemination 

3. Have annual regional meetings to discuss joint problems and model programs 

4. Contact with other states, and the National Center to exchange ideas, 
techniques 
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PLAN 3 

Margaret Ferqueron, David McOuat, and Harold Cramer 
State Department of Education 
Florida 



Needs 

1. New, better, more cost- 
effective inservice 



2. Guidelines for planning and 
and adapting facilities for 
competency-based and 
individual programs 

3. Effective evaluation of 
dissemination and diffusion 
programs 



Resources 

1. Jan Treichel about 
Bloomington, IN; Clyde Knight 
of OK/'Talk-back TV", Central 
Texas College, Killeen, TX; 
Civil Eng. Dept., Miss. St. 
U* -"Electronic Screen" 
ATV-telephone combination; 
Erma Keyes (PA) use of one 
inservice specialist in each 
school district 

2. Literature search^completed 
National Center for 
Research in Vocational 
Education and Council of 
Educational Facility Planners 

3. None located 



Next Steps 

!• Contact resources 

2. Contact resources and identify and visit facilities which have 
been planned or adapted for competency-based and individualized 
facilities 

3. Search for sources of information 
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PLAN 4 
Alyce Williamson 
State Department of Education 
Kansas 



Needs 

Leadership/administrative 
skills for business/office 

Model for dissemination- 
State Staff of 1 

Sex equity for business/ 
office 

Entrepreneurship 



Special Learners — especially 
those who can't read# all areas 



Resources 



Pregnant teenagers 
Product selection 



(nothing indicated) 



2* Ohio/ Oklahoma 



3. 



(nothing indicated) 



6. 

7. 



National Center for Research 
in Vocational Education 

American Proprietary 
Institute f Central Texas 
College 

California 

National Center for 
Research in Vocational 
Education 



Next Steps 
Assessment and analysis of where we are 

Follow-up to other states to obtain what we want and need 
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PLAN 5 
Carol Sanders ' 
University of Illinois 



Needs 



Resources 



Ideas on how to obtain state 
administrative support for 
naming an individual whose 
primary responsibility is for 
dissemination ef forts 



1. States that have a dissemi- 
nation system: FL, OH, OR, 
PA, OK 



Effective, workable needs 
assessment instrument 



2. South Carolina, Michigan 



3« Specifications for quality 
control 



3. John Atkins, Georgia 



4* Effective ways of collabora- 
tion with existing networks/ 
agencies 



4. Oklahoma 



5. Ideas on how to identify key 
individuals on the local level 
who can serve as liaison and 
assist with staff develop- 
ment and technical assistance 
activities 



5. Carroll Curtis, Pennsylvania 



6. Knowledge of best time and 

techniques for staff develop- 
ment and assistance 



6. George Kosbab, Ohio 



7. Methods to use for assessing 
effectiveness of disseminated 
R&D outputs 



Ohio State University 



8. Directory of individuals within 
states whose primary responsi- 
bilities are for dissemination 



8. Mailing list of conference 
participants 



Next Steps 

1. Contact resources to obtain needed information to assist in 
development and refinement of proposed dissemination system 

2» Obtain state support and commitment to implement the system 
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3. Disseminate plan to all actors involved and obtain commitment for 
collaboration in carrying out the system 

4. Revise system as needed 
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VII. DISSEMINATION AND ITTILIZATION PROGRAM INTERACTION WITH THE FIELD 
A Report on What the D&U Program Has Been Up To 



Norman Singer and Alta Moser 
National Center for Research in Vocational Education 



EKLC 



71 

67 



WHAT'S TIIF. DSIJ PROGRAM BEHN UP TO? | 
SELI-Crni) SUMMARY DATA THROUGH JULY 31, lOHO 
These data portray in part the achievements of the Dissemination it. • 

dissemination and transaction statistics were achieved primarily durin. a 1 1/2 v T 
durino Year« tt -^^ 1 TTT r u iinariiy Quring a 1 1/2 year period 

aunng "tears II and III of the National Center contract. Nom Sirviei^ cm.i Alta Mcacr 



PART I 



ERIC 



N'UMBIiR PRODUCTS/ 
DESCRIPTIONS 
RHFFtRRED TO PRODUCT 
M/VNAGHMENT PROJECT 




NUMBER PRODUCTS 
DEVELOPED AN'D 
DISSEMINATED BY 
DtiU 



BROCilURES/\EWSLETTHRS 
PROniJCi:D AND DISSEMI- 
NATED BY DfiU 



DF,U RELATED ARTICLES 
PUBLISHED STATE/ 
REG rON'AL/N'ATI OVAL 



FIELD DISSEMINATION 
EVENTS CONDUCTED 3Y 
OR INVOLVING OfiU/ 
NUMBER PARTICIPANTS 



FIELD DISSE: .NATION 
EVENTS CONDUCTED RV 
OTJIERS AND CAl^VCITATED 
BY DfiU 



NUMBER CONSULTANTS 
TO Dr.U 
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Total Number of Interactions for 
39 States/Territories 

Total Number of Interactions for 
57 Statcb/Territor ies (Projectedl 



2245 



3555 



PART I la 





h.\CETS Or DiVJ ACFI^'ITY J 


:iUMBF.R or 

INTERACTIiViS 
-OR i9 STATLS/ 
TERRITCRIES 


PtKCtST OF 

inti:ii/\c:t IONS ! 


NUMBliR OF 

isrrRACTioNS 
roR s7 status; 

TFHRITORI ES 
JPro j ected ) 


s: 


NOMINrXTIOSS 
SOLICITED 


207 


9 


326 


G 
•J 

UJ 


PROiJUCTS 
NOMINATHD 


381 


17 


60U 


c= 

□t 
1— 

i.j 

•-J 


PRODUCT STATUS 
COMMUN I GATED 


^^^ 


20 


700 


PRODUCT 
COARORORATrD 


40 


5 


63 


DISSEMINATION 
STRATEGIES PLANNT.O 


?1 


1 


3 5 


1 aut!u:r N'hcor iat io\.-' 

1 PJ^OnUCT CONCtP'i 


! 


1 


50 


-< 

m 

-< 

! 


' MEMO DIl^T'^IBUTI' N'^ 


r 

1 62 


3 


98 


DISTRIBUTED 


\ 

1001 


4 5 


) 573 


hRocniJiins 

DISTP.r^^M pi) 


\ 

1046 


47 


: 6 50 


PAIITICTPATION/ 

.-3 U P P 0 il T / C 0 N* F E R E; N C F: / 

WORKS iiOP 


300 


13 


175 


1 — Ui 
1 C3 1— 


JlSSt>i:NAll::N 
COLLABORATION 


1 i 

i 598 ! 27 
1, f 


943 



Px\RT lib 



*!*^rsonal ; rod v'elive-v aad rf^-iponcicv ro rcqucsts-- 
rov.al distribution ^ 1 600. 
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PART lie 



FACETS OF DtU ACTIVITY 


NIIMHTR or 

I ST I' tl ATT in«.'^ 

FOR J9 STATLS/ 
TERRITOHILS 


PCRCliNT OC 
TOTAL 
InTERACTlONS 


NUMSLR OF 
INTIRACTIONS 
lOk S7 STATES/ 
TERRITORIES 
■proj ccted) 




PROACTIVE 


788 


35 


1242 


^ o 
o a: 


RESPONSIVE 


1455 


6: 


2293 


>- 


NCRVE 


245 


1' 


386 1 


k C E N C 


STATE, REGIONAL 


875 


39 


1380 


o 
z 


I PA 


325 


14 


512 


z 


COLLEGE 


615 


27 


970 




PRIVATE/PUBLIC 
PROFESSIONAL 


288 


i3 


454 




SECONDARY 


807 


36 


1273 


> 

at ° 


POSTSECONDARY 


876 


39 


1381 


< 

z 
o 


COLLEGE/ 
UNIVERSITY 


250 


11 


394 


C A T 1 
on b 


ADULT 
EDUCATION 


99 


4 


156 


Q 


ACROSS THE BOARD 


715 


32 


1124 




cpY FntrTTY 
OCA CV^Ulil 


940 


42 


1482 






S02 


? "» 


792 


UJ 

X 


PLANN IN'G 


452 


20 


713 


UJ 

X 
H 


EVALUATION 


386 


17 


609 


O 

3 


PERSONNEL 
DLIVELOPMBNT 


446 


20 


703 


-1 U 
LU O 


OCCUPATIONAL 
INSTRUCTION 


419 


19 






niSSFMlNATlON 


4 88 




7 69 




OTHf-R 


11 (» 


5 


183 

^ — .1 
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COMPLlMENTARy DISTRIBUTION 
OF FIELD-BAStD 
(S L E C T E D) PRODUCTS 

Through D^iu program 
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►In addition to the selected products, !)ciU hn? v! i ssrmi natcd 
ain^osT 10*^,000 }j romo t i on.'i I nnd informational pieces, 

including ovor ^'.OOD conies of Kesou roe Jpda to 1079: ^ " 

't \ i'tui'ty in Voca t i on;il r.d^ti ca t i on . * J 
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VIII. DETERMINING THE IMPACT OF RESEARCH AND DEVELOPMENT PRODUCTS 

(Presentation Notes) 



William L. Hull 
National Center for Research in Vocational Education 
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DETERMINING THE IMPACT OF RESEARCH AND DEVELOPMENT PRODUCTS 

(Presentation Notes) 



William Hull 



What are the legislative requirements > 



For research and curriculuin? 



P.L, 94-482, 

Subpart 3/ section 
131 (b) and 133 (b) 



"No contract shall be made 
pursuant to subsection (a) 
unless the applicant can 
demonstrate a reasonable 
probability that the con- 
tract will result in im- 
proved teaching techniques 
or curriculum materials 
that will be used in a 
substantial number of 
classrooms or other learning 
situations within five years 
after the termination date of 
s uch contract • " 



For exemplary and innovative programs? 

P.L. 94-482/ 
Subpart 3 / section 
132 (c) 



"The annual. . accountability 
report. . .shall indicate the 
proposed disposition of the 
progreun or project following 
the cessation of Federal 
support and the means by which 
successful or promising pro- 
grams or projects will be 
continued and expanded within 
the State." 



Why focus on products to study impact? 



^Products contain program improvement ideas 
^Products are tangible 

**Products can be used in a reliable manner 
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Definitions used in the National R&D Product Evaluation Study 



Distribution: The physical transportation of products from one location to 
another 

Use: The application of a product toward resolution of an 
educational problem 

Impact: Measurable change resulting from the introduction of a research 
and develoi^^nent product into an educational setting 

Why collect impact data? 

<*To learn baseline information such as the quantity of products flowing to 
the field 

<*To establish trends in use of products 

<>To write accounte±>ility reports to sponsors 

•^To make intelligent revisions in products 

oTo write persuasive, compelling proposals for new programs 
**To identify new areas of client need 

^To determine the effectiveness of dissemination strategies 
''To identify inhibitors of full implementation 
'>To obtain reactions to policy alternatives 
**To obtain cost/benefit information 

How can a state meet its needs for impact data? 

Through records^ including information on the — 

^•number of field initiated requests answered 
«names and addresses of visitors to project sites 
<>n\imber of products distributed 

<*nujT±>er of persons present at mservice meetings 
**number of presentations to meetings/conventions 
'^number of products accepted for inclusion in ERIC 

Through ad hoc surveys-- 
®of special audiences 

<*to determine relationships among proposed priorities 
«to determine "gain'* scores 

°to compare similar products in a structured manner 
Through focused interviews 

^to understand reasons for outcomes and 
oto identify unanticipated outcomes 
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CONFERENCE SUMMARY 



Joel H. Magi SOS 
Associate Director, Information Systems Division 
National Center for Research in Vocational Education 
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CONFERENCE SUMMARY 



Joel H» Magisos 

The theme of the Third Annual Dissemination and Utilization Conference was 
"organizing for dissemination collaboration". The general conference goals 
were to (1) clarify problems^ (2) identify exemplary programs and promising 
practices, and (3) develop plans for dissemination and utilization 
collaboration. In many respects and for most of the conference participants, 
the conference goals were achieved. 

To set the stage for the conference, Charles Mojkowski clearly defined the 
elements of the conference theme and put it into perspective with program 
improvements He helped us understand the contributions that collaboration 
could make to our programs and related these to the usual inadequacies of D&U 
activities. He explained that collaboration is frequently impeded by 
impractical or vague goals, failure to estimate costs, insufficient or 
inadequate incentives, or inadequate technology. He stressed the need to 
capitalize on our differences and similarities, to consider the costs of not 
collaborating, to establish both intersystem and intrasystem relationships, to 
base our collaborations on a strong conceptual framework, and to increase the 
incentives for collaboration. In auiother important address, Daniel Dunham 
shared his perspectives on the importance of dissemination to the improvement 
of vocational education and his six C*s of collaboration: (1) Contact, (2) 
COTimtmicate, (3) Cooperate, (4), Coordinate, (5) Consolidate, and (6) 
Collaborate • 

In our effort to clarify problems encountered in developing dissemination 
progrsmis, we met as large, moderate and small state groups. As a total group, 
fifty-three percent of the conference participants identified the "need for 
administrative commitment" as their most important dissemination problem. The 
second and third most important dissemination problems v^ich conference 
participants selected were the "need for dissemination and evaluation 
strategies as a part of initial planning" and the "determination of 
appropriate dissemination strategies". Participants frcm large states gave 
weight to two items as being of major concern — "need for administrative 
commitment" and the "need for dissemination and evaluation strategies as part 
of initial product development planning". Participants from moderate size 
states identified the "need for administrative commitment" as their most 
important dissemination problem followed by "quality control for content and 
format of products" and the "need for dissemination and evaluation strategies 
as part of initial product development planning". All in the small state 
group agreed on "allocation of scarce resources" as the most important 
dissemination problem- Perhaps these problems need to be studied more 
carefully first, but eventually they must become the basis for solutions, 
whether they be legislative, administrative, or technical. 
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Conference participants benefited from descriptions of four exrimplary 
state dissemination programs. Margaret Ferqueron described Florida's large 
exemplary dissemination program in terms of its adequate resoxircesr strong 
administrative support, and linkage through regional vocational program staff. 
Nancy Hargis provided another exemplary model from Oregon wherein the program 
is administratively associated with other educational dissemination programs 
and linkage is through regional coordinators • Erma Keyes explained that 
Pennsylvania's long-runnj ^g Vocational Education Information Network (VEIN) 
aims for effective service at reasonable cost to specified target audiences. 
This program is an exajnple of a service contracted outside of the state 
agency. Robert Patton (Oklahoma) described a program which is carefully 
articulated with the instructional materials laboratory, curriculum 
coordination centers, and regional consortium. While facetiously described as 
simple and directive, it is in fact sophisticated and participatory. Heavy 
emphasis is put upon goal setting, early planning, targeting to audiences, and 
use of existing program supervisory staff. It has the agency's commitment and 
financial support. The factors to vrfiich these presenters attributed their 
programs' success seem mor e-than-coincidental reciprocals of the problems 
identified in earlier sessions by conference participants. 

Promising practices in dissemination were identified in group sessions. 
The groups focused the overwhelming majority of their attention on strategies 
emphasizing person-to-person contacts. Most frequently cited was on-site 
pre-service or in-service training via workshops and seminars on products 
and/or exemplary programs* Conferences and professional meetings on the state 
level received almost equal mention; excmiples included, a product awareness 
conference featuring both in-state and out-of-state products, and an annual 
statewide dissemination conference for both teachers and administrators. 
Resource centers at the local or regional level were also popular. 
Interestingly, print media (newsletters, brochures, catalogues) accounted for 
only a few of the suggested practices. The concept of networking, both for 
information and resource sharing, in-state and between states, appeared in 
some form in almost one-quarter of the practices cited. These included 
cooperative development activities between states and contracting between 
states to address shared needs; regional curriculxim planning; and systems such 
as interlibrary loan. Also mentioned in this context was the need to utilize 
existing networks, such as the NDN. Rebecca Douglass, Nancy Hargis, and Janet 
Treichel shared ideas on how to organize collaborative dissemination programs 
at regional, state and university levels. But in the final analysis, the 
conference participants will have to decide for themselves how they can 
actually collaborate with others. In the group sessions, many specific ways 
to collaborate were identified merely by sharing problems and solutions. 
While a national conference provides an excellent way to exchange ideas, we 
need a better means to exchange information more rapidly and efficiently. 
Modern technology offers a means of doing this soon. We must find a way to 
implement electronic ccnmxinication techniques and to organize to use this 
technology appropriately. 
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our conference ended with sessions on National Center activities— data on 
the DSU Program's interaction with the field (Singer and Moser) , strategies 
for determining the impact of R&D products, and the programs in each of the 
National Center's divisions. Conference participants and others should regard 
all o. these activities as potential opportunities for collaboration with the 
National Center. 
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APPENDIX A 

THIRD ANNUAL NATIONAL VOCATIONAIi EDUCATION 
DISSEMINATION AND UTILIZATION CONFERENCE 
NATIONAL CENTER FOR RESEARCH IN VOCATIONAL EDUCATION 

COLUMBUS, OHIO 
NOVEMBER 12-14, 1980 

THEME: ORGANIZING FOR DISSEMINATION COLLABORATION 



WEDNESDAY, NOVEMBER 12, 198 0 

AM CHAIRPERSON: CAROL KDWLE 

7:30 AM BREAKFAST MEETING OF RCU AND NNCCVTE EXECUTIVE COMMITTEES 

(Stouffer's University Inn) Kenneth Gabbert 

Rebecca Douglass 

An opportunity for RCU and NNCCVTE Executive 
Comiaittee members to discuss common concerns. 

9:00 AM WELCOME 

(Room 1A) Robert E, Taylor 

9:15 AM ^PRESENTATION OF CONFERENCE GOALS 

(Room 1A) Joel Magisos 

Participants will reach agreement on common 
problems in dissemination, take home ideas 
concerning s uccessf ul dissemination strat^ 
egies and programs, and develop collabora- 
tive plans which apply exemplary strategies 
to di s semination pr oblems • 

9:30 AM KEYNOTE ADDRESS — "Organizing for Dissemination Collaboration" 

(Room 1A) Charles Mojkowski 

Educat ion Se rvice 
Group 

10:30 AM BREAK 
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10:45 AM 



TWO SIMULTANEOUS SESSIONS 

Each session will be held twice. Participants may choose to 
attend one session and examine products or attend both sessions. 



ORIENTATION TO D&U NETWORKS AND SYSTEMS (new collaborators) 
(Room 1C) Joel Magisos 

Norman Singer 

Background on dissemination and utilization and 
relationships among D&U actors, and information 
on dissemination systems and networks 
(30 minutes) . 

NEW SELECTED D&U PRODUCTS 

(Room 1A) Alt a Moser 

Overview of selection process and information 
on new selected products (30 minutes). 

12:00 PM LUNCH 

PM CHAIRPERSON: NORMAN SINGER 

1:00 PM PROBLEMS IN ORGANIZING FOR DISSEMINATION COLLABORATION 

Discussion groups will identify and clarify common and \anigue 
problems in organizing for dissemination. Each group will 
develop a list of major problems. The lists will be combined 
into a master list which participants will react to on Thursday ^ 
November 13* 

Group A-Large States (Room 1A) Margaret Ferqueron 

Group B-Large States (Room IB) Nona Verloo 

Group C~Moderate-sized States (Room 1C) Kenneth Gabbert 
Group D-Modera-^.e-sized States (Room 1C) Janet Treichel 
Group E-Small States (Room 1A) Valerie Pichanick 

2:30 PM BREAK 

3:00 PM Resume 1:00 PM Discussion Groups 

4:00 Pt*! Adjourn 
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6:00 PM NO HOST SOCIAL HOUR 

(Stouffer's University Inn) 

7:00 PM BANQUET 

(Stouffer's University Inn) 

"Collaboration for Program Improvement in the Eightic-s" 

Daniel Dimham 
Visiting Scholar 
National Center 

NATIONAL CENTER PRODUCT DISPLAY (ALL DAY) 
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TffURSDAY, NOVEMBER 13, 1980 



AM CHAIRPERSON: CAROL KOWLE 

7:30 AM BREAKFAST MEETING OF MULTI-STATE, MULTI-YFAR COOPERATIVE 

RESEARCH EFFORT STATES 

(Stouffer's University Inn) Kenneth Gabbert 

An opportunity for MSMYE states to report on 
their progress and plan next steps. 

8:30 AM PROBLEMS IN ORGANIZING FOR DISSEMINATION COLLABORATION 

Stimmary and consensus 
(Room 1A) Janet Adkins 

Jaynee FouSt 

Part icipant s will rate the importance of di s~ 
semination problems via an instrument based 
on lists generated Wednesday afternoon • 

9:00 AM EXEMPLARY DISSEMINATION PROGRAMS 

(Room 1A) Nancy Hargis 

Margaret Ferquero.i 
Erma Keyes 
Robert Pat ton 

Representatives from four exemplary state pro- 
grams wi 11 outline the ir successful strategies 
and techniques. Speakers will make 15 minute 
informal presentations . Participants are 
encoiiraged to ask questions during the dis- 
cus s ion pe r iod * 

10:30 hlA BREAK 

10:45 AM IDENTIFICATION OF PROMISING DISSEtdlNATION PRACTICES 

Carol Kowle 

Groups from ^7ednesday p.m. will reassemble to share promising 
disseminatic n practices. &iiphasis will be on sp^^cific dissemi- 
nation acti^'ities which are transportable to a variety of 
settings • 

Group A~Large States ( Room lA) Nona Verloo 

Group B~Large States (Room IB) Margaret Ferqueron 

Group C~Moderate-sized States ( Room 1 C ) Kenneth Gabbert 
Group D~Moderate-sizGd States (Room IC) Janet Treichel 
Group E-Small States (Room 1A) Valerie Pichanick 

12:00 PM LUNCH 
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PM CHAIRPERSON: NORMAN SINGER ■ • 

1:00 PM DEVELOPING COLLABORATIVE DISSmiNATION AND UTILIZATION PROGRAMS 

{Room 1A) Rebecca Douglass 

Nancy Hargis 
Janet Treichel 

Directors of dissemination programs at the 
regional , state , and university levels will 
present ideas on how to plan for collabora- 
tive di ssemi nation and ut il ization 
programs . 

2:00 PM DEVELOPMENT OF PLANS FOR D&U COLLABORATION 

(Rooms 1A, 1B, 1C) Norman Singer 

Participants will divide into groups based on 
their organizational, agency, or institutional 
affiliation and develop collaborative dissemi- 
nation plans for the coming year. Focus will 
be on matching needs with resources and 
identifying action steps. 

4:30 PM Adjourn 



FREE EVENING TO ATTEND A PLAY OR CONCERT r TOUR GERMAN VILLAGE, DINE TOGETHER 
{DETAILS LATER) OR JUST DO TOUR OWN THING 



NATIONAL CENTER PRODUCT DISPLAY (ALL DAY) 
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FRIDAY, NOVEMBER 14, 1980 



AM 



CHAIRPERSON: 



CAROL KOWLE 



8:30 AM 



DScU INTERACTION WITH THE FIELD 
(Room .1 A) 



Norman Singer 
Alta Moser 



National Center staff will present facts about 
interaction with the field, drawing from data 
compiled by the D&U Program. 



9:00 AM 



DETERMINING THE IMPACT OF R&D PRODUCTS 
(Room lA) 



William Hull 
Kay Adams 



Two brief presentations on strategies for 
assessing impact and meeting legi slative 
requirements. An open discussion period 
wi 11 foil ow . 



10:00 AM 



WHAT'S GOING ON AT THE NATIONAL CENTER? 



{Rooms 1A, IB, 1C) 

National Center division leaders will bring participants up to 
date on project work. Division representatives will speak to 
small groups about their division activities. Participants may 
choose to attend two of seven group sessions ^ 

RESEARCH Richard Miguel 

Transferable occupational skills / experiential 
learning and basic skills/ and predicting 
occupational choice , plus a new direction for the 
Research division- -improving cp^x^rt unities for 
the labor market participation of disadvantagt^'^ youth* 

DEVELOPMENT Lucy Thrane 

An overview of development division program 
areas / including sex fairness / comprehensive 
planning, special populations/ life--long 
career development/ and performance-based 
education • 
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EVALUATION AND POLICY 



N. L. McCaslin 



An overview of evaluation materials and an 
update on projects designed to provide 
evidence on the effects of participation 
in vocational education • 



PERSONNEL DEVELOPMENT 



Ferman Moody 



Emerging trends of interest to RCU personnel, 
emphasizing National Academy for Vocational 
Education initiatives, CETA technical assis- 
tance and traini.ng, and new thrusts in 
business/industry/labor linkages • 

SPECIAL PROJECTS James Weber 

An overview of several cooperative efforts 
among secondary school districts and post- 
secondary insti cut ions in order to better 
meet their programmatic needs in areas of 
vocational training • 

INFORMATION SYSTEMS Joel Magi SOS 

Three major pro ject s--the National Center 
Clearinghouse, the ERIC Clearinghouse on 
Adult, Career^ and Vocational Education, 
and the Resource and Referral Service-- 
what they are, how they work, how to use 



them. 



FIELD SERVICES 



Maria Peterson 



Technical assistance available from the 
National Center staff and the Vocational 
Educator for conferences , work shops , 
and other inservice activities . 



11:00 AM 



CONFERENCE SUMMARY AND EVALUATION 



Joel Magisos 



An analysis of what we have learned from 
the conference and an opportunity for 
participants to evaluate the structure 
and content of the conference. 



12:00 



Adjourn 



NATIONAL CENTER PRODUCT DISPLAY (ALL DAY) 
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APPENDXX B 
PART XCI PANTS 
THIRD ANNUAL DStU CONFERENC E 



AXoABAMA 

John M« Rothi ^ Resf^airchi Assooiav.<D 
State E>epa.3r t-me^n t of Ec3\aca.tion 
Room 607 Stia-t^ OEfics 3et±lt:iinoF 
Mon tg^omoxry ^ AI-» 3 6 13 0 

Wo lis WcLrrxr , Reseairohi Associate 
Stait-=^ Oepar-tment of Eci\ac«a. t ion 

Division of Vooationeii Ec^uoation Searvioes 
ReseatircVi Coor*<di na.t ing Unit 
847 State Office Butil<iing 
Montgomeiry , AX. 3 6130 

ARIZONA 

Ken GalDbezTt, RCU Diirectoir 
State Depairtment of Eciucation 
15 3 5 West Jeffer*son 
Phioeni>c^ AZ 85007 

Roloeart Ker* wooci , Chia i irp^eir son 
Inciustjrial anci Vocational Eciiacation 
Nor-thieirn Arizona Univeirsity 
P.O. Box 6015 

Inciias tir i al and Vocaxz ion a 1 Eciiacation Def>ar" tment 
Flagstaff, AZ SSOll 

CALIFORNIA 

Nona Vexrloo, Consialtant 

State Department of Ecixjcation 

Vocational E<di-ication Unit 

721 Cai^itol Mall, Fouirth Floor 

Sacxramento , CA 95814 

CONNECTICUT 

Valerie Pichaniclc, Associate Consultant 

T xreau of Vocational Procpram P 1 an n x ncf and Developmen 

Division of Vocational and Actialt Education 
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Mict-ii<gan Depairtment of Education 
Box: 30 009 
Laxisin^, MI 48Q09 

CHiris Olson 
Proj ects Cooirciinato r: 
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U.S. Department of Education 

Room 503 4, ROB #3 

7th and D Streets, SW 

Washington, DC 20202 

Marcia L. Miller 

Education Program Specialist 

Office of Vocational and Adult Education 

Department of Education 

Room 5018, ^OB #3 

7th and D Streets, SW 

Washington, DC 2 0202 

WEST VIRGINIA 

Roy Thomas , RCU Director 
Ma r sh al 1 Un iv er s i ty 
Huntington WV 25701 

r»arry Froehlich, Director 
Vocational Curriculum I^aboratory 
Cedar Lakes Conference Center 
Ripley, WV 25271 

WISCONSIN 

Roland Krogstad, RCU Director 

Wisconsin Board of Vocational, Technical and Adult Education 

FrPSOB^ '-'^7thr Floor" - 

480 2 Sheboygan Avenue 
Madison, WI 53702 



EKLC 



1 04 



APPENDIX C 
NATIONAL. CENTER STAFF 



Kay Adams 

Re-iearch Spec iali st 
Center Eva.luation Team 



Alta Moser 

Progrr am Associate 

Information Systems Division 



Janice Adkins 

Grariuate Research Associate 
In-formation Systems Division 

Dan Dunham 
Visiting Scholar 

Jaynee Foust 

Graduate Research Associate 
Infoirmation Systems Division 

Shelley Grieve 
Pul>lications Spec iali st 
Information Systems Division 



Ruth Nun ley 
Support Staff 

Information Systems Division 

Carl Oldsen 
Research Spec iali st 
Information Systems Division 

Cheryl Peters 

Graduate Research Associate 
Information Systems Division 

Maria Peterson 

As sociate Director 

Field Sexrvices Division 



Raymond Harlan 
Proijram Ax sis tan t 
Information Systems Division 



Fr ank Pr a t z n e r 

Actin-g Assooi^^te Director 

Research Division 



Bill Hull 

Senior Research Specialist 
Center M^^nagement 



Janet Ray 
Suppor t Staf f 

Information Systems Division 



Joel Magisos 
Associate Director 
Information Systems Division 

Bonnie Marshall 

Graduate Research Associate 

information Systems Division 

Richard Miguel 

Rese arch Specialist 

Research Division 

N» Lr- M.cCaslin 
Associate Dir ector 

Evaluation and Policy Division 



Regina Sealey 
Suppo X- 1 St a f f 

Information Systems Division 
Norman Singex" 

Senior Research Specialist 
Liaison for Dissemination Pro 
Information Systems Division 

ft 

Marianne Thompson 
Program Assistan::: 
Information Systems Division 

Lucy Thrane 

^js so c late Oi r ecto r 

Development Divi sion 



Ferman Moody Judy Wagner 

Associate Director Librarian 

Personnel Development Division Information Systems Division 



105 



Jim VJeber 

Research Specialist 
Special Projects 

Carol Williams 
Support Staff 

Information Systems Division 



Conference Coordinator : 

Carol Kowle 
Research Special ist 
Information Systems Division 



Conference Secretaries : 

Donna Loney 
Clarine Cotton 

Informatics Systems Division 



1 06 



